BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Negative_regulation events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Negative_regulation 379 ( 130) 306 ( 130) 34.30 42.48 37.96
[JULIELab ] Negative_regulation 379 ( 151) 491 ( 151) 39.84 30.75 34.71
[ConcordU ] Negative_regulation 379 ( 98) 196 ( 98) 25.86 50.00 34.09
[UT+DBCLS ] Negative_regulation 379 ( 100) 254 ( 100) 26.39 39.37 31.60
[VIBGhent ] Negative_regulation 379 ( 86) 247 ( 86) 22.69 34.82 27.48
[ UNSW ] Negative_regulation 379 ( 67) 232 ( 67) 17.68 28.88 21.93
[ UZurich ] Negative_regulation 379 ( 56) 158 ( 56) 14.78 35.44 20.86
[ SCAI ] Negative_regulation 379 ( 52) 212 ( 52) 13.72 24.53 17.60
[UAntwerp ] Negative_regulation 379 ( 41) 140 ( 41) 10.82 29.29 15.80
[ UNIMAN ] Negative_regulation 379 ( 47) 229 ( 47) 12.40 20.52 15.46
[ NICTA ] Negative_regulation 379 ( 41) 222 ( 41) 10.82 18.47 13.64
[ UMich ] Negative_regulation 379 ( 72) 702 ( 72) 19.00 10.26 13.32
[CIPS-ASU ] Negative_regulation 379 ( 50) 481 ( 50) 13.19 10.40 11.63
[ Cam ] Negative_regulation 379 ( 26) 72 ( 26) 6.86 36.11 11.53
[ UTokyo ] Negative_regulation 379 ( 25) 90 ( 25) 6.60 27.78 10.66
[ UAveiro ] Negative_regulation 379 ( 25) 111 ( 25) 6.60 22.52 10.20
[CNBMadrid] Negative_regulation 379 ( 36) 466 ( 36) 9.50 7.73 8.52
[ Team 24 ] Negative_regulation 379 ( 20) 133 ( 20) 5.28 15.04 7.81
[ASU+HU+BU] Negative_regulation 379 ( 15) 28 ( 15) 3.96 53.57 7.37
[CCP-BTMG ] Negative_regulation 379 ( 10) 22 ( 10) 2.64 45.45 4.99
[ KoreaU ] Negative_regulation 379 ( 2) 3 ( 2) 0.53 66.67 1.05
[ PIKB ] Negative_regulation 379 ( 1) 1 ( 1) 0.26 100.00 0.53
[ Team 09 ] Negative_regulation 379 ( 1) 4 ( 1) 0.26 25.00 0.52
[ USzeged ] Negative_regulation 379 ( 0) 0 ( 0) 0.00 0.00 0.00
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Negative_regulation 379 ( 96) 254 ( 96) 25.33 37.80 30.33
[UAntwerp ] Negative_regulation 379 ( 41) 140 ( 41) 10.82 29.29 15.80
[ Team 24 ] Negative_regulation 379 ( 20) 136 ( 20) 5.28 14.71 7.77
[CNBMadrid] Negative_regulation 379 ( 31) 466 ( 31) 8.18 6.65 7.34
[ASU+HU+BU] Negative_regulation 379 ( 14) 28 ( 14) 3.69 50.00 6.88
[CCP-BTMG ] Negative_regulation 379 ( 9) 22 ( 9) 2.37 40.91 4.49
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------